Automatic Parallelization for Distributed - MemorySystems : Experiences

نویسندگان

  • Hans P. Zima
  • Peter Brezany
  • Barbara M. Chapman
  • Jan Hulman
چکیده

Distributed-memory systems (DMMPs) are powerful tools for solving large-scale sci-entiic and engineering problems. However, these machines are diicult to program since the data must be distributed across the processors and message-passing operations must be inserted for communicating non-local data. In this paper, we discuss the automatic parallelization of Fortran programs for DMMPs, based on the programming paradigms associated with Vienna Fortran and High Performance Fortran. After introducing the state of the art, as represented by currently implemented systems, we will identify a number of limitations of this technology. In addition to insuucient functionality for handling many real applications, a major deeciency of current systems is the lack of intelligence in selecting good transformation strategies. We argue that a knowledge-based approach to compiling will contribute to more powerful and intelligent automatic parallelization systems in the future.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Comparative Survey of Approaches to Automatic Parallelization

Automatic parallelization in a compiler is becoming more important as computer technologies expand to include more distributed computing. This paper focuses on a comparative study of past and present techniques for automatic parallelization. It includes techniques such as scalar analysis, array analysis, and commutativity analysis. The need for automatic parallelization in compilers is growing ...

متن کامل

Comparison Of Automatic And Manual Techniques For Distributed Computing

Manual Parallelization, Understand the Problem and the Program Distributed memory systems require a communication network to connect May be able to be used in conjunction with some degree of automatic parallelization. To enhance the technique, the structure of a complex network can be extended. A comparison analysis of environmental factors affecting software reliability Automatic detection of ...

متن کامل

Parallelization of Radiation Therapy Treatment Planning(RTTP) : A Case Study

Radiation therapy uses ionizing radiation to treat cancerous tumors. This paper reports our experiences with the parallelization of a real-world 3-D radiation therapy treatment planning (RTTP) system on a wide range of platforms, including SMP servers, Cray J916 vector machines, and clusters of SMPs. The RTTP system is a meta-problem, comprising two major loosely-coupled components: dose calcul...

متن کامل

Distributed Machine Learning: Foundations, Trends, and Practices

In recent years, artificial intelligence has achieved great success in many important applications. Both novel machine learning algorithms (e.g., deep neural networks), and their distributed implementations play very critical roles in the success. In this tutorial, we will first review popular machine learning algorithms and the optimization techniques they use. Second, we will introduce widely...

متن کامل

Computer Science Technical Report Canonic Multi-Projection: Memory Allocation for Distributed Memory Parallelization

The Polyhedral model is now the accepted technology for automatic parallelization of affine control loop programs. It has been successful in automatically generating tiled shared memory parallel programs for shared memory platforms (plus vectorization). We address the challenges arising when we move toward distributed memory parallelization, based on wavefront execution of parameterized tiles. ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 1993